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CLAIMS 

We claim: 

1 . A machine implemented method for producing virtual camera motion, 
5 comprising the steps of: 

receiving a set of two or more images of a scene; 

identifying foreground for at least a subset of said images of said scene; and 
creating a video of said scene conveying an illusion of a camera moving 
around said scene, said step of creating a video is based on said set of two or more 
1 0 images and said step of identifying foregroimd. 

2. A method according to claim 1, wherein said step of identifying 
foreground comprises the steps of: 

subtracting a first image of said scene from a second image of said scene to 
15 create a first difference, said first image and said second image are from a first 
camera; 

subtracting a third image of said scene from said second image to create a 
second difference, said third image is from said first camera; and 

creating a union of said first difference and said second difference, said 
20 union identifies said foreground. 

3. A method according to claim 2, wherein said step of identifying 
further comprises the steps of: 

creating clusters of on pixels in said first difference; 
25 creating clusters of off pixels in said first difference; 

removing small clusters of on pixels in said first difference; 

filling in small clusters of off pixels in said first difference; 

creating clusters of on pixels in said second difference; 

creating clusters of off pixels in said second difference; 
30 removing small clusters of on pixels in said second difference; and 
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filling in small clusters of off pixels in said second difference. 

4. A method according to claim 3, wherein said step of identifying 
further comprises the steps of: 

5 filtering said first difference; 

filtering said second difference; and 
filtering said union. 

5. A method according to claim 3, wherein said step of identifying 
1 0 further comprises the steps of: 

creating clusters of on pixels in said union; 
creating clusters of off pixels in said union; 
removing small clusters of on pixels in said union; and 
filling in small clusters of off pixels in said union. 

15 

6. A method according to claim 1 , wherein: 

said step of receiving includes receiving a first video image, a second video 
image and a third video image; 

said first video image views a foreground object at a first angle; 
20 said second video image views said foreground object at a second angle; 

said third video image views said foreground object at a third angle; 
said step of creating a video includes creating a first set of one or more new 
video images and a second set of one or more video images; 

said first set of one or more video images appear to view said foreground 
25 object at angles between said first angle and said second angle; 

said second set of one or more video images appear to view said foreground 
object at angles between said second angle and said third angle; and 

said video includes said first set of one or more video images and said second 
set of one or more video images. 
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7. A method according to claim 6, wherein: 

said video further includes at least a portion of said first video image prior to 
said first set of one or more video images, at least a portion of said second video 
image prior to said second set of one or more video images and at least a portion of 
5 said third video image subsequent to said second set of one or more video images. 

8. A method according to claim 6, wherein said step of creating a video 
includes the step of: 

creating one or more blurred backgrounds based on said step of identifying 
10 foreground, said first set of one or more video images and second set of one or more 
video images include said blurred backgrounds. 

9. A method according to claim 6, wherein said step of creating a video 
includes the step of: 

15 creating one or more solid backgrounds based on said step of identifying 

foreground, said first set of one or more video images and second set of one or more 
video images include said solid backgrounds. 

10. A method according to claim 6, wherein said step of creating a first 
20 set of one or more video images comprises the steps of: 

blending said first video image with said second image using different 
blending factors to create different backgrounds for said first set of one or more 
video images; and 

blurring said backgrounds of said first set one or more video images using 
25 different blurring factors for at least a subset of said one or more video images. 

11. A method according to claim 10, wherein said step of identifying 
foreground comprises the steps of: 
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subtracting a fourth video image from said first video image to create a first 
difference, said fourth video image and said second video image are from a first 
camera; 

subfracting a fifth video image from said second video image to create a 
5 second difference, said fifth image is from said first camera; and 

creating a union of said first difference and said second difference, said union 
identifies said foreground. 

12. A method according to claim 6, wherein creating a first set of one or 
10 more video images comprises the steps of: 

finding edges in said first video image; 
finding edges in said second video image; 
finding edges in said third video image; 

creating matches of at least portions of edges in said first video image, said 
15 second video image and said third video image; 
creating chains of said matches; 
discarding bad chains; and 

creating morphs of at least a portion of said first video image and said second 
video image based on said chains. 

20 

13. A method according to claim 6, wherein creating a first set of one or 
more video images comprises the steps of: 

identifying edges in said first video image and said second video image; 
interpolating positions for said edges in said first set of one or more video 
25 images; and 

blending regions of said first video image between said edges with regions of 
said second video image between said edges according to different blending factors 
for each of said first set of one or more new video images, said blending factors 
correlate to said interpolated positions. 

30 
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14. A method according to claim 1 , wherein: 

said scene appears frozen in time in said illusion of said camera moving 
around said scene. 



5 15. A method according to claim 1, wherein said step of creating a video 

comprises the steps of: 

warping a first image from a first camera to a second image from a second 
camera; 

warping a third image from a third camera to said second image from said 
10 second camera; 

removing foregrounds from said first image, said second image and said third 

image; 

filling in background for said removed foreground in said first image, said 
second image and said third image; 
15 creating new images by blending backgrounds of said first image with said 

second image and said second image with said third image; 
blurring said new images; 
morphing said removed foregrounds; 
adding said morphed foregrounds to said new images; and 
20 imwarping said new images. 

16. A method according to claim 1, wherein said step of creating includes 
the steps of: 

creating one or more video images having blurred backgrounds based on said 
25 step of identifying foreground; and 

assembling said created one or more video images into said video. 

17. A method according to claim 1, wherein said step of creating includes 
the steps of: 
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creating one or more video images by blending a first image from a first 
camera with a second image from a second camera using different blending factors to 
create different backgrounds for said one or more video images; 

blurring said backgrounds of said one or more video images using different 
5 blurring factors for at least a subset of said one or more video images; and 

assembling said created one or more video images into said video. 

18. A method according to claim 1 , wherein said step of creating includes 
the steps of 

10 creating one or more video images having solid backgrounds based on said 

step of identifying foreground, said video includes said video images having solid 
backgrounds; and 

assembling said created one or more video images into said video. 

15 19. A. method according to claim 1, wherein said step of creating 

comprises the steps of: 

finding edges in a first video image from a first camera; 
finding edges in a second video image from a second camera; 
finding edges in a third video image from a third camera; 
20 creating matches of at least portions edges in said first video image, said 

second video image and said third video image; 
creating chains of said matches; 
discarding bad chains; 

creating morphs of at least a portion of said first video image and said second 
25 video image based on said chains; 

creating a new set of video images, adding said morphs to said new set of 
video images; and 

assembling said new set of images into said video. 
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20. A machine implemented method for producing virtual camera motion, 
comprising the steps of: 

receiving two or more images of a scene which view a foreground object 
from a first set of different angles; 
5 identifying foreground for said two or more images of said scene; and 

creating one or more new images of said scene based on said two or more 
images and step of identifying, said new images appear to view said foreground 
object from new angles different than said first set of different angles. 

10 21. A method according to claim 20, wherein said step of identifying 

foreground comprises the steps of: 

subfracting a first image of said scene from a second image of said scene to 
create a first difference, said first image and said second image are from a first 
camera; 

15 subtracting a third image of said scene from said second image to create a 

second difference, said third image is from said first camera; and 

creating a union of said first difference and said second difference, said union 
identifies said foreground. 

20 22. A method according to claim 20, fiirther comprising the step of: 

assembUng said new images of said scene into a movie that conveys the 
illusion of a camera moving around said scene as said scene appears frozen in time. 

23. A method according to claim 20, wherein: 

25 said one or more video images are created with blurred backgrounds based on 

said step of identifying foreground. 

24. A method according to claim 20, wherein said step of creating one or 
more new images comprises the steps of: 
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creating said one or more new images by blending a first image from a first 
camera with a second image from a second camera using different blending factors to 
create different backgrounds for said one or more new images; 

blurring said backgrounds of said one or more new images using different 
5 blurring factors for at least a subset of said one or more new images; and 

assembling said created one or more video images into a video. 

25. A method according to claim 20, wherein said step of creating one or 
more new images comprises the steps of: 

10 creating said one or more new images having solid backgrounds based on 

said step of identifying foreground; and 

assembling said created one or more video images into said video. 

26. A method according to claim 20, wherein said step of creating one or 
15 more new images comprises the steps of: 

finding edges in a first video image from a first camera, said two or more 
images of a scene include said first video image; 

finding edges in a second video image from a second camera, said two or 
more images of a scene include said second video image; 
20 finding edges in a third video image from a third camera, said two or more 

images of a scene include said third video image; 

creating matches of at least portions edges in said first video image, said 
second video image and said third video image; 
creating chains of said matches; 
25 discarding bad chains; 

creating morphs of at least a portion of said first video image and said second 
video image based on said chains; 

creating a new set of video images, adding said morphs to said new set of 
video images; and 
30 assembling said new set of images into a video. 
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27. A machine implemented method for identifying foreground, 
comprising the steps of: 

receiving a first image from a first camera; 
receiving a second image from said first camera; 
receiving a third image from said first camera; 

subtracting said second image from said first image to create a first difference 
subtracting said third image from said first image to create a second 
difference; and 

creating a union of said first difference and said second difference, said 
union identifies said foreground. 

28. A method according to claim 27, further comprising the steps of: 
creating clusters of on pixels in said first difference; 

creating clusters of off pixels in said first difference; 
removing small clusters of on pixels in said first difference; 
filling in small clusters of off pixels in said first difference; 
creating clusters of on pixels in said second difference; 
creating clusters of off pixels in said second difference; 
removing small clusters of on pixels in said second difference; and 
fiUing in small clusters of off pixels in said second difference. 

29. A method according to claim 28, further comprising the steps of: 
filtering said first difference; 

filtering said second difference; and 
filtering said union. 

30. A method according to claim 28, fiirther comprising the steps of: 
creating clusters of on pixels in said union; 

creating clusters of off pixels in said union; 
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removing small clusters of on pixels in said union; and 
filling in small clusters of off pixels in said union. 

31. One or more processor readable storage devices having processor 
5 readable code embodied on said processor readable storage devices, said processor 

readable code for programming one or more processors to perform a method 
comprising the steps of: 

receiving a set of two or more images of a scene; 

identifying foreground for at least a subset of said images of said scene; and 
10 creating a video of said scene conveying an illusion of a camera moving 

around said scene, said step of creating a video is based on said set of two or more 
images and said step of identifying foreground. 

32. One or more processor readable storage devices according to claim 
15 31, wherein said step of identifying foreground comprises the steps of: 

subtracting a first image of said scene firom a second image of said scene to 
create a first difference, said first image and said second image are from a first 
camera; 

subtracting a third image of said scene from said second image to create a 
20 second difference, said third image is from said first camera; and 

creating a union of said first difference and said second difference, said union 
identifies said foreground. 

33. One or more processor readable storage devices according to claim 
25 31, wherein said step of creating includes the steps of: 

creating one or more video images having blurred backgrounds based on said 
step of identifying foreground; and 

assembling said created one or more video images into said video. 
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34. One or more processor readable storage devices according to claim 
31, wherein said step of creating includes the steps of: 

creating one or more video images by blending a first image fi-om a first 
camera with a second image from a second camera using different blending factors to 
create different backgrounds for said one or more video images; 

blurring said backgrounds of said one or more video images using different 
blurring factors for at least a subset of said one or more video images; and 

assembling said created one or more video images into said video. 

35. One or more processor readable storage devices according to claim 
31, wherein said step of creating comprises the steps of: 

finding edges in a first video image firom a first camera; 
finding edges in a second video image fi-om a second camera; 
finding edges in a third video image firom a third camera; 
creating matches of at least portions edges in said first video image, said 
second video image and said third video image; 
creating chains of said matches; 
discarding bad chains; 

creating morphs of at least a portion of said first video image and said second 
video image based on said chains; 

creating a new set of video images, adding said morphs to said new set of 
video images; and 

assembling said new set of images into said video. 

36. One or more processor readable storage devices according to claim 
31, wherein said step of creating a video comprises the steps of: 

warping a first image fi-om a first camera to a second image fi*om a second 
camera; 

warping a third image fi-om a third camera to said second image fi-om said 
second camera; 
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removing foregrounds from said first image, said second image and said third 

image; 

filling in background for said removed foregroimd in said first image, said 
second image and said third image; 
5 creating new images by blending backgrounds of said first image with said 

second image and said second image with said third image; 
blurring said new images; 
morphing said removed foregrounds; 
adding said morphed foregrounds to said new images; and 
10 unwarping said new images. 

37. An apparatus, comprising: 
a communication interface; 
one or more storage devices; and 
15 one or more processors in communication with said one or more storage 

devices and said communication interface, said one or more processors programmed 
to perform a method comprising the steps of: 

receiving a set of two or more images of a scene, 

identifying foreground for at least a subset of said images of said 

20 scene, and 

creating a video of said scene conveying an illusion of a camera 
moving around said scene frozen in time, said step of creating a video is based on 
said set of two or more images and said step of identifying foreground. 

25 38. An apparatus according to claim 37, wherein said step of identifying 

foreground comprises the steps of: 

subtracting a first image of said scene from a second image of said scene to 
create a first difference, said first image and said second image are from a first 
camera; 
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subtracting a third image of said scene from said second image to create a 
second difference, said third image is from said first camera; and 

creating a union of said first difference and said second difference, said 
union identifies said foreground. 

5 

39. An apparatus according to claim 37, wherein said step of creating 
includes the steps of: 

creating one or more video images by blending a first image from a first 
camera with a second image from a second camera using different blending factors to 
1 0 create different backgrounds for said one or more video images; 

blurring said backgrounds of said one or more video images using different 
blurring factors for at least a subset of said one or more video images; and 

assembling said created one or more video images into said video. 

15 40. An apparatus according to claim 39, fiarther comprising: 

three cameras; 

camera control electronics connected to said camera; 

synchronization elecfronics in communication with said camera control 
electronics; and 

20 one or more time code inserters in communication with said camera control 

electronics and said processor, said cameras capture said two or more images of said 
scene, said time code inserters insert time codes into said two or more images of said 
scene including said first image and said second image, said step of creating one or 
more video images by blending uses said time codes in said first image and said 

25 second image. 

41. One or more processor readable storage devices according to claim 
37, wherein said step of creating includes the steps of: 

creating one or more video images having blurred backgrounds based on said 
30 step of identifying foreground; and 
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assembling said created one or more video images into said video. 

42. One or more processor readable storage devices having processor 
readable code embodied on said processor readable storage devices, said processor 
readable code for programming one or more processors to perform a method 
comprising the steps of: 

receiving two or more images of a scene which view a foreground object 
from a first set of different angles; 

identifying foreground for said two or more images of said scene; and 
creating one or more new images of said scene based on said two or more 
images and step of identifying, said new images appear to view said foreground 
object from new angles different than said first set of different angles. 

43. One or more processor readable storage devices according to claim 
42, wherein said step of identifying foreground comprises the steps of: 

subtracting a first image of said scene from a second image of said scene to 
create a first difference, said first image and said second image are from a first 
camera; 

subtracting a third image of said scene from said second image to create a 
second difference, said third image is from said first camera; and 

creating a union of said first difference and said second difference, said 
union identifies said foreground, 

44. One or more processor readable storage devices according to claim 
42, wherein said method fiirther comprises the step of: 

assembling said new images of said scene into a movie that conveys the 
illusion of a camera moving around said scene as said scene appears frozen in time. 

45. One or more processor readable storage devices according to claim 
42, wherein said step of creating one or more new images comprises the steps of: 
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creating said one or more new images by blending a first image from a first 
camera with a second image from a second camera using different blending factors to 
create different backgrounds for said one or more new images; 

blurring said backgrounds of said one or more new images using different 
5 blurring factors for at least a subset of said one or more new images; and 

assembling said created one or more video images into a video. 

46. One or more processor readable storage devices according to claim 
42, wherein said step of creating one or more new images comprises the steps of: 

10 finding edges in a first video image from a first camera, said two or more 

images of a scene include said first video image; 

finding edges in a second video image from a second camera, said two or 
more images of a scene include said second video image; 

finding edges in a third video image from a third camera, said two or more 
1 5 images of a scene include said third video image; 

creating matches of at least portions edges in said first video image, said 
second video image and said third video image; 

creating chains of said matches; 

discarding bad chains; 

20 creating morphs of at least a portion of said first video image and said second 

video image based on said chains; 

creating a new set of video images, adding said morphs to said new set of 
video images; and 

assembling said new set of images into a video. 

25 

47. An apparatus, comprising: 
a communication interface; 

one or more storage devices; and 
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one or more processors in communication with said one or more storage 
devices and said communication interface, said one or more processors programmed 
to perform a method comprising the steps of: 

receiving two or more images of a scene which view a foreground 
5 object from a first set of different angles, 

identifying foreground for said two or more images of said scene, and 
creating one or more new images of said scene based on said two or 
more images and step of identifying, said new images appear to view said foreground 
object from new angles different than said first set of different angles. 

10 

48. An apparatus according to claim 47, wherein said step of identifying 
foreground comprises the steps of: 

subtracting a first image of said scene from a second image of said scene to 
create a first difference, said first image and said second image are from a first 
1 5 camera; 

subtracting a third image of said scene from said second image to create a 
second difference, said third image is from said first camera; and 

creating a union of said first difference and said second difference, said 
union identifies said foreground. 

20 

49. An apparatus according to claim 47, wherein said step of creating one 
or more new images comprises the steps of: 

creating said one or more new images by blending a first image from a first 
camera with a second image from a second camera using different blending factors to 
25 create different backgrounds for said one or more new images; 

blurring said backgrounds of said one or more new images using different 
blurring factors for at least a subset of said one or more new images; and 

assembling said created one or more video images into a video. 

30 50. An apparatus according to claim 49, fiirther comprising: 
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three cameras; 

camera control electronics connected to said camera; 

synchronization electronics in communication with said camera control 
electronics; and 

5 one or more time code inserters in commimication with said camera control 

electronics and said processor, said cameras capture said two or more images of said 
scene, said time code inserters insert time codes into said two or more images of said 
scene including said first image and said second image, said step of creating one or 
more video images by blending uses said time codes in said first image and said 

10 second image. 



51. An apparatus according to claim 47, wherein said method further 
comprises the step of: 

assembling said new images of said scene into a movie that conveys the 
1 5 illusion of a camera moving around said scene as said scene appears frozen in time. 

52. An apparatus according to claim 51, wherein said step of creating one 
or more new images comprises the steps of: 

finding edges in a first video image from a first camera, said two or more 
20 images of a scene include said first video image; 

finding edges in a second video image from a second camera, said two or 
more images of a scene include said second video image; 

finding edges in a third video image fi-om a third camera, said two or more 
images of a scene include said third video image; 
25 creating matches of at least portions edges in said first video image, said 

second video image and said third video image; 
creating chains of said matches; 
discarding bad chains; 

creating morphs of at least a portion of said first video image and said second 
30 video image based on said chains; 
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creating a new set of video images, adding said morphs to said new set of 
video images; and 

assembling said new set of images into a video. 

5 53. One or more processor readable storage devices having processor 

readable code embodied on said processor readable storage devices, said processor 
readable code for programming one or more processors to perform a method 
comprising the steps of: 

receiving a first image from a first camera; 
10 receiving a second image from said first camera; 

receiving a third image from said first camera; 

subtracting said second image from said first image to create a first difference 
subtracting said third image from said first image to create a second 
difference; and 

15 creating a union of said first difference and said second difference, said 

union identifies said foreground. 



54. One or more processor readable storage devices according to claim 
53, wherein said method further comprises the steps of: 
20 creating clusters of on pixels in said first difference; 

creating clusters of off pixels in said first difference; 

removing small clusters of on pixels in said first difference; 

filling in small clusters of off pixels in said first difference; 

creating clusters of on pixels in said second difference; 
25 creating clusters of off pixels in said second difference; 

removing small clusters of on pixels in said second difference; and 

filling in small clusters of off pixels in said second difference. 



55. One or more processor readable storage devices according to claim 
30 54, wherein said method ftirther comprises the steps of: 
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filtering said first difference; 
filtering said second difference; and 
filtering said union. 

5 

56. One or more processor readable storage devices according to claim 
53, wherein said method further comprises the steps of: 

creating clusters of on pixels in said union; 
creating clusters of off pixels in said union; 
10 removing small clusters of on pixels in said union; and 

filling in small clusters of off pixels in said union. 

57. An apparatus, comprising: 
a communication interface; 

1 5 one or more storage devices; and 

one or more processors in communication with said one or more storage 
devices and said communication interface, said one or more processors programmed 
to perform a method comprising the steps of: 

receiving a first image from a first camera, 
20 receiving a second image from said first camera, 

receiving a third image from said first camera, 

subtracting said second image from said first image to create a first 

difference, 

subtracting said third image from said first image to create a second 

25 difference, and 

creating a union of said first difference and said second difference, 
said union identifies said foreground. 

58. An apparatus according to claim 57, wherein said method further 
30 comprises the steps of: 
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creating clusters of on pixels in said first difference; 
creating clusters of off pixels in said first difference; 
removing small clusters of on pixels in said first difference; 
filling in small clusters of off pixels in said first difference; 
5 creating clusters of on pixels in said second difference; 

creating clusters of off pixels in said second difference; 
removing small clusters of on pixels in said second difference; and 
filling in small clusters of off pixels in said second difference. 



10 59. An apparatus according to claim 58, wherein said method fiirther 

comprises the steps of: 

filtering said first difference; 
filtering said second difference; and 
filtering said union. 

15 

60. An apparatus according to claim 57, wherein said method further 
comprises the steps of: 

creating clusters of on pixels in said union; 
creating clusters of off pixels in said union; 
20 removing small clusters of on pixels in said union; and 

filling in small clusters of off pixels in said union. 
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